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Abstract 

The theory of computational complexity focuses on functions and, hence, studies programs whose 
interactive behavior is reduced to a simple question/answer pattern. We propose a broader theory whose 
ultimate goal is expressing and analyzing the intrinsic difficulty of fully general interactive behaviors. 
Q_[ To this extent, we use standard tools from concurrency theory, including labelled transition systems 

(formalizing behaviors) and their asynchronous extension (providing causality information). Behaviors 
are implemented by means of a multiprocessor machine executing CCS-like processes. The resulting 
theory is shown to be consistent with the classical definitions: when we restrict to functional behaviors 
(i.e., question/answer patterns), we recover several standard computational complexity classes. 

1 Introduction 

In the early days, computers were considered as oracles: one would have a question and the computer 
would provide the answer. For instance, one day the American army had just launched a rocket to the 
Moon, and the four star General typed in two questions to the computer: (1) Will the rocket reach the 
Moon? (2) Will the rocket return to the Earth? The computer did some calculations for some time and then 
ejected a card which read: "Yes." The General was furious; he didn't know whether "Yes" was the answer 
to the first question, the second or both. Therefore he angrily typed in "Yes, what?". The computer did 
some more calculations and then printed on a card: "Yes, Sir.'U 

That every computation may eventually be reduced to the input/output pattern is an assumption un- 
derlying most of classical computability theory. The theory of computational complexity is an excellent 
example: it studies the intrinsic difficulty of problems, which are nothing but "yes or no" questions. Ac- 
cordingly, the classical methods that measure the complexity of a program ignore the possibility that it may 
interact with its environment between the initial request and the final answer; even when a more complex 
interaction pattern is considered {e.g., in interactive proofs [?]), it often is seen as yet another way to solve 
problems (viz. the class IP, which is a class of problems). 

Nowadays, we live in a world of ubiquitous computing systems that are highly interactive and com- 
municate with their environments, following possibly complicated protocols. These computing systems 
are fundamentally different from those that just provide answers to questions without any observable inter- 
mediate actions. To study this phenomenon of interactive computation [?], theoretical computer scientists 
have developed several formalisms and methodologies, such as process calculi and algebras. 

However, little has been done so far to tackle the computational complexity of interactive systems (one 
of the few examples being the competitive analysis of online algorithms [?]). Note that, as mentioned 
above, this issue is beyond the classical theory of computational complexity. Thus, we set out to provide 
grounds for a revised theory of computational complexity that is capable of gauging the efficiency of 
genuinely interactive behaviors. 
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The first conceptual step is the formalization of behaviors. Our approach follows standard lore of 
concurrency theory: a behavior is an equivalence class of labelled transition systems (LTS), which in turn 
are usually specified using process calculi, such as Milner's CCS [?]. In this paper, we use a variation 
of bisimilarity as behavioral equivalence; however, other equivalences that have been proposed in the 
literature, such as coupled similarity and testing, work equally well, as long as certain minimal requirements 
are satisfied. Shifting the focus towards behaviors, the fundamental question of classical computational 
complexity "What is the cost of solving a problem (or implementing a function)?" becomes "What is the 
cost of implementing a behavior?". 

A suitable cost model is not as easily found as in the functional case where we just measure the re- 
sources (time, space) required to compute the answer as a function of the size of the question. Of course, 
the resources depend on the chosen computational model (such as Turing machines), but the general scheme 
does not depend on the specific model. We propose a notion of cost for general interactive behaviors that 
abstracts away from a specific model. Costs are attributed to events in weighted asynchronous LTS (or 
WALTS): asynchrony is a standard feature that is added to transition systems to represent causal dependen- 
cies [?], which we need to generalize the trivial dependency between questions and answers; weights are 
used to specify additional quantitative information about space and time consumption. 

Finally, we introduce a computational model, the process machine, which implements behaviors (just 
as Turing machines implement functions) by executing concurrent programs written in a CCS-based lan- 
guage. Such a machine has an unbounded number of processors each equipped with a private memory 
and capable of performing basic string manipulation and communicating asynchronously with other pro- 
cessors or the external environment. The process machine admits a natural semantics in terms of WALTSs 
and thus provides us with a non-trivial, paradigmatic instance of our abstract framework for measuring the 
complexity of behaviors. 

Complexity classes are then defined as sets of behaviors that can be implemented by a process running 
within given time and space bounds on the process machine. We conclude by showing that if we restrict to 
functional behaviors (i.e., trivial input/output patterns) we obtain several standard complexity classes; thus, 
at least in many paradigmatic cases, we have in fact a consistent extension of complexity theory into the 
realm of interactive computation. As a further sanity check, we verify that the complexity of a function is 
invariant under some different (but intuitively equivalent) representations that may be given of it in terms 
of behaviors. 

2 Behaviors 

In this section we formally define behaviors as equivalence classes of labelled transition systems. Such 
systems can receive messages on some input channels, send messages on some output channels, and per- 
form internal, invisible, computation. With the aim of being as concrete as possible, we consider messages 
to be binary strings. We denote by W — {0, 1}* the set of such strings, with e denoting the empty string. 
We also fix two disjoint sets I, O of input and output channel names. 

Definition 1 (Labelled transition system) An input action (resp. output action) is an element ofXxW 
(resp. O x W); together, they form the set of visible actions, denoted by A v . The set of actions is A = 
A v U {t}, where r is the internal action. 

A labelled transition system (LTS for short) is a triple S = (|<S|, s , transs), where \S\ is a set, whose 
elements are called states, s G |<S| is the initial state, and trans^ C |<S| x A x |<S| is the transition relation. 

Given an LTS S, we write s -^4 s' when (s, a, s') G trans^. Since internal computation is invisible, it is 
standard practice to consider several internal steps as one single, still invisible step. We denote by ==>■ the 
reflexive-transitive closure of — and, given a G A v , we write s t just if there exist s' , t' such that 



The standard notion of equivalence of transition systems is bisimilarity. 

Definition 2 (Bisimilarity) Let S, T be LTSs, with initial states sq, to, respectively. A simulation from S 
to T is a relation 1Z C \S\ x |T| such that (s , to) G 1Z and, for all (s, t) G 1Z, we have: 
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1. if s — > s' with a G A v , then there exists t' such that t ==> t' and (s', t') G TZ; 

2. if s — — >• s', then there exists t' such that t => t' and (s', t') G TZ. 

A simulation IZfrom S to T is a bisimulation if7Z op = {(£, s) G \T\ x \S\ | (s, t) G 7?.} « a simulation 
from T to S. We define S ~ T iff there exists a bisimulation between S and T. This relation is called 
bisimilarity. 

Bisimilarity can be shown to be an equivalence relation. 

For our purposes we furthermore require that the equivalence does not introduce divergence. Given 
s G |>S|, we say that there is a divergence at s (denoted as sf|~) if there exists an infinite sequence s — > 

T T 

si — > s 2 — > ■■■■ 

Definition 3 (Divergence-sensitive bisimilarity) We say that a (bi) simulation TZ between S and T does 
not introduce divergence if for all (s, t) G TZ, iff implies sfr. We define divergence-sensitive bisimilarity, 
denoted by «d> by requiring the existence of a bisimulation not introducing divergence. 

For our purposes, weaker equivalences (such as coupled simulation [?, ?]) suffice, and might actu- 
ally even be desirable. Whatever equivalence is chosen, the essential point is that it does not introduce 
divergence. 

Definition 4 (Behavior) A behavior is a w ^-equivalence class. 

In the sequel, it will be useful to have a compact notation for describing LTS's. For this, we shall use a 
notation similar to the syntax of Milner's CCS [?]. For instance, if / : W — > W is a function, i(x).o(f(x)) 

denotes the LTS whose states are {so}U[J^ eW {s^, t^} and whose transitions are sq and ^ > 

for all £ G W. This kind of LTS is used to define the behaviors that correspond to classical input/output 
computations. 

Definition 5 (Functional behavior) In the following, we fix two channels i G T and o G O. Let f : 

W — > W be a function. The functional behavior induced by f, denoted by f f, is the equivalence class of 
i(x).o(f(x)). We denote by TUN the set of all functional behaviors. 

Lemma 1 Let f, g : W ->• W. Then, f = gijfff = f g . 

Definition 6 (Language of a functional behavior) By Lemma \J] every functional behavior b G TUN 
determines a unique function funb on W such that b = ffunb- This induces a language (i.e., a subset ofW) 
langb = {£GW I funb (£) = £>. 



3 Abstract Cost Models for Interactive Computation 

In order to define the complexity of behaviors, we need to add concurrency and causality information 
to keep track of the dependencies of outputs on relevant, "previous" inputs and to identify independent 
"threads" of computation in a parallel algorithm. There are several models of concurrency in the literature 
(see [?] for an overview of standard approaches). Asynchronous transition systems [?], which are an exten- 
sion of the well known model of Mazurkiewicz traces [?], are sufficiently expressive for our purposes. In 
order to speak about complexity, we shall add a notion of weight: on transitions, for time complexity, and 
on states, for space complexity. This justifies our choice of asynchronous transition systems, which have 
an explicit notion of state, over the a priori simpler model of Mazurkiewicz traces. 

Definition 7 (Asynchronous LTS [?]) An asynchronous lts (alts) is a tuple S — (\S\, sq, £(S), transs, 
) where \S\ is a set of states, sq G |<S| is the initial state, £ (S) is a set of event types, transs Q 
\S\ x £(S) x |5| is the transition relation and ^5 is an antireflexive, symmetric relation on £(S), called 
independence relation, such that (using the notations of Definition^: 
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7. a G £(S) implies s t for some s,t G 

2. s — — > s' one/ s — s" implies s' = s"; 

3. a\ a2 awe/ s — ^ si, s S2 implies 3t G |<S| s.f. si i anof S2 4* 

4. ai o <22 awe/ s — ^ si -2% £ implies 3s2 G |<S| s.f. s — ^ S2 £• 

In complete analogy to the definitions for Mazurkiewicz traces, we have trace equivalence classes of 
transition sequences in ALTSs and we define events with the expected causality relation that relates them. 

Definition 8 (Run, trace equivalence, event, causal order) A run in an alts S is a finite, possibly empty 
sequence of consecutive transitions tp = s — ^ • • • t, which we denote by s — > t. Concatenation of 
runs is denoted by juxtaposition. Trace equivalence, denoted by ~, is the smallest equivalence relation on 

runs such that, for all a\ r\ a%, if tp = s — > s — > Si — > t — > t and ip — s — > s — > S2 — > t — > 
t' with s, s\, S2,t as in point 3 of Definition^ then tp ~ ip. We define a preorder between runs by tp < ip 

iff ~ W' ' f or some run tp'. A run tp is essential if it is of the form sq s t, with sq the initial state 

of S, and for all ip ^ tp, we have ip = sq — > s — t with ip' ~ tp' . 

An event is a ^-equivalence class of essential runs. We denote by Ev(<S) the set of events of S; it 
is a poset under the quotient relation < / ~, which we denote by < and call causal order. Note that, if 
e G Ev(5), all tp G e "end" with the same transition; we denote by evtype(e) the event type of this 
transition. 

Finally we can add data for "time consumption" of event types and the "size" of states, which allow to 
define the time and space cost of events. 

Definition 9 (Weights) A weighted ALTS (WALTS) is a triple (S, w t ,w s ), where S is an ALTS, w t : £{S) — > 
N is the time weight, and w s : \S\ ->Nis the space weight. 

Let tp = so — • • • s n be a run. Its space cost is space(i/?) = maxo<i<„ w s (si). The space cost 
of an event e G Ev(«S) is space(e) = max^ge space(t^). 

Let e G Ev(5). We denote by tot(e) the set of chains of events, i.e., totally ordered subsets o/(Ev(iS), < 
), whose maximum is e. The time cost of e is 

time(e) = max } w t (evtype(<i)). 

xetot(e) ' 

Roughly speaking, the space cost of events is independent of their scheduling; however, for the time 
cost of an event we assume an "ideal" scheduler that fully exploits all concurrency of the WALTS. 

4 The Process Machine 

We start by defining string expressions and Boolean expressions, which are generated by the following 
grammar: 

E,F::=x\£ \ 0(E) \ 1(E) \ tail(E) 
B:;=tt \ff\ 7 (E) \ e ? (E), 

where x ranges over a denumerably infinite set of variables, and £ ranges over W. 
Processes are defined by the following grammar: 

P,Q::=0\ A(Ex,...,E n ) \ 0(E). P \ I(x).P \ B.(P,Q) \P\Q. 

where O stands for either an output channel o G O or a string expression, I stands for either an input 
channel i G X or a string expression, E, E\, . . . , E n range over string expressions, and A ranges over a 
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Nil: [(o,M) ps r]e [r]e 

Rec: [(A(E u ...E n ),M) p ,T]e -A [(P, {a* ^ E™ , . . . , x n M- E™ }) p , T]0 

with A(x± , . . . , x n ) d = P 

Snd: [(E{F).P,M) p ,T]Q ^ [(P,Af) p ,r]0' 

with 0'(P M ) = B{E M ) ■ F M , 
and 0' = everywhere else 

Rev: [(E(x).P,M) p ,T}e [(P, M U {z ^ T]©' 

only if 0(P M ) = £-q. Then, 0'(P M ) = q 
and 0' = everywhere else 

Out: [(o(P).P,Af) p ,r]0 L_>> [(PAf) p ,r]0 

inp: [(*(x).p,M) p ,r]e [(?,iu{i4S,r]e 

end- ffflfpo^Mi ne -A / [(^»^)p>r]e ifp^ = «, 
end. K^.(pg),M) p ,iju — > i [ ( Q 7 M) p ,r]0 ifB M =ff 

Spn: [(P| Q,M) p ,r]0 -A [(P, M) p0 , (Q, M) pl , T]0 



Table 1: The transitions of the process machine. 



denumerably infinite set of process identifiers, each coming with an arity n £ N and a defining equation of 
the form 

A(x\, ...,x n ) = P 

where P is a process whose free variables are included in x\, . . . , x n . As usual in process calculi, the free 
variables of a process (denoted by FV(P)) are defined to be the variables not in the scope of an input prefix 
I(x), which binds x. A process P is closed if FV(P) = 0. In the following, all bound variables of a 
process are supposed to be pairwise distinct. 

To assign values to expressions, we use environments, i.e., finite partial functions from variables to W. 
If E is a string expression whose variables are all in the domain of an environment M, we define its value 
E M by induction: x M = M(x); £ M = f; 0(E) M = 0E M ; 1(E) M = 1E M ; and tail{E) M = £ if 
E M = 6£, with & £ {0, 1}. Similarly, we define the vaZi<e of Boolean expressions: tt M — tt; ff M = ff; 
? (£') M = tt if E M = 0C, otherwise it is ff; and £ ? (£) M = tt if E^ 7 = e, otherwise it is if. 

Definition 10 (Machine configurations, transitions) A processor state is a triple (P, M) p where P is a 
process, M is an environment whose domain includes FV(P), and p is a binary string, the processor tag. 

A queue function is a function from W to finite lists o/W, which is almost everywhere equal to the 
empty list. In the following, lists of words are ranged over by q, and we denote by ■ their concatenation. 

A configuration C is a pair [T] 0, where T is a set of processor states whose processor tags are pairwise 
incompatible in the prefix order (i.e., no processor tag is the prefix of another), and is a queue function. 

Definition 11 (LTS of a process) Let P be a closed process. We define [P] to be the LTS generated by 
Table\l\with the initial state [(P, 0) e ]e (empty environment, tag and queue function). 

The reader acquainted with process algebras will note how, in spite of the presence of output prefixes 
in the syntax of processes, the machine treats outputs asynchronously: strings are sent (internally or exter- 
nally) without waiting to synchronize with a receiver. 

Given a deterministic Turing machine computing the function / : W — > W, it is possible to exhibit 
a closed process P such that [P] 6 ff; moreover, the execution of this process on the machine uses only 
one processor. Many more standard, "functional" models of computation can be simulated by our process 
machine (see [A}. However, the process machine is obviously richer, in the sense that it may implement 
more complex, "non-functional" interactive behaviors. 

As announced, each transition will be given a weight, and each configuration a size. For every string 
expression E and Boolean expression B, given an environment M whose domain contains the variables of 
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E and B, we fix positive integers timeAf (E) and timeM (B), representing the time it takes for a processor 
with environment M to compute the string E M and the Boolean B M . In the following we denote by |£ 
the length of £ G W, and the size of an environment M is \M\ — X) a ;edom(A/)(l^( :z; )l + -0- 

Definition 12 (Weight of transitions and size of configurations) The weight of a machine transition t, 
denoted by %t, is defined as follows, with reference to Table\J] 



Nil : 


$f = 


1 




Out : 


$t = 


1 - 


1- timeM 


Rec : 


$t = 


1 - 


1" J2i=i timeAf (Ei) 


Inp : 


$t = 


1 - 


H£l 


Snd : 


$t = 


1 - 


h time M (E) + time a/ (P) 


Cnd : 


$t = 


1 - 


h timeAf(S) 


Rev : 


$t = 


1 - 


htime M (E) + |£| 


Spn : 


$t = 


1 - 


h \M\ 



If q is a list of strings, its size \q\ is the sum of the lengths of the strings appearing in q; then, 
the size of a queue function is |0| = X^edom(e) l®(£)l- Finally, the size of a configuration C = 

[(Pi, mo, . . . , (p„, M„)]e is \c\ = \e\ + e?=i \Mi\. 

Definition 13 (WALTS of a process) We define the set of operations as Op = {Nil, Rec, Snd, Rev, 
Out, Inp, Cnd, Spn}. Let P be a closed process. We define a WALTS [P] as follows: 

- |[P]| = |[P]|; 

- the initial state is [(P, 0) £ ]e; 

- £(JP]) is the set of all (p,l,n) £ W x Op x N s.t. in [P] there is a transition t of type I performed by 
a processor whose tag is p and s.t. $t = n; 

- the independence relation is the smallest symmetric relation s.t. (p, I, n) ^ (p' , I' , n') holds as soon as 
p p' and one of the following conditions is met: 

- I £ {Snd, Rev, Out, Inp}; 

- I G {Snd, Rev} and I' G {Out, Inp}; 

- 1,1' G {Snd, Rev} and the transitions concern different queues; 

- 1,1' G {Out, Inp} and either I ^ V or the transitions concern different external channels. 

- transjpj — {(C, {p, I, n), C) \ V(C, a, C) G transjpj performed by processor p of type I and weight 
n}; 

- the time weight is Wt((p, I, n)) = n, and the space weight is w s (C) = \C\. 

Note that two Snd/Rcv transitions on the same queue are never independent. This amounts to forbid- 
ding concurrent access to a queue, even when this could be safe. We could consider queues with concurrent 
access at the price of some technical complications. In this extended abstract, we prefer not to address such 
an arguably minor detail. 

5 Complexity Classes 

We now propose our definition of complexity classes of behaviors. We essentially measure the cost of 
producing an output as a function of all the inputs that are below it in the causal order. 

Definition 14 (Input and output events, input size) Let P be a closed process. An input event ( resp. 
output event) of [P] is an event d G Ev([Pj) s.t. evtype(d) is an input (resp. output) on an external 
channel. In the input case, if the string read is £, we set \d\ = |£| + 1. Let e be an output event, and 
let Inp(e) be the set of input events below e (w.r.t. the causal order). We define the input size of e as 

INI = Edelnp(e) 14 

Definition 15 (Cost of a process) Let /, g : N — > N. We say that P works in time / and space g if for 
every output event e of [P], time(e) < /(||e||) and space(e) < <?(||e||). 

Definition 16 (Complexity class) Let f, g : N — > N. We define BTS(/, g) to be the set of behaviors b 
such that there exists a process P such that [P] G b and P works in time f and space g. 

As sanity check we show that, in the case of functional behaviors, we essentially recover the standard 
complexity classes. 
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Definition 17 (Functional complexity) Let f,g : N — > N. We define the set of languages FXJNTS(f, g) = 

lang(BTS(/,#)n.7W). 

In the following, TIME(/) and ATIME(/) denote the standard time complexity classes (languages 
decidable by a deterministic and alternating Turing machine in at most f(n) steps, respectively). 

Theorem 2 Let /, # : N -)• N. 

7. TIME(/(n)) C FUNTS(/(n),/(n)); 

2. FUNTS(/(n),s(n)) C TIME(0(f(n)g(n) h )) for a constant integer h > 0; 

3. ATIME(/(n)) C PUNTS (/(n), 2 C W"»). 

Proof. Points (1) and (3) are proved by efficiently encoding Turing machines and alternating Turing ma- 
chines in the process machine (see IA. II and IA.2t . For point (2), we simulate with a deterministic Turing 
machine the execution of a process P implementing a functional behavior. This is possible because, by the 
properties of the non-determinism that may be present during the execution of P is actually vacuous: 
when facing a configuration with more than one active processor, the Turing machine may simulate any one 
of them, without worrying about influencing the outcome or falling into infinite computations. Simulating 
a single transition of the process machine may be assumed to require at most c • g(n) h Turing machine 
steps, where c, h! are constant. Now, a simple combinatorial argument based on the maximum length of 
runs (which is f(n)) and the maximum number of active processors (which is g(n)) gives that the Turing 
machine halts after simulating at most f(n)g(n) transitions, yielding the desired bound. The details are 
given in|B] □ □ 

Corollary 3 Every standard polynomial or superpolynomial deterministic complexity class may be refor- 
mulated in terms of FUNTS(/, g). For instance: 

P = (J FUNTS(n fc ,n fc ), EXP = (J FUNTS(2"\ 2""). 

k<u k<cj 

Thanks to the well know equality PSPACE = AP, Theorem|2]also immediately implies the inclusion 
PSPACE C \J k<UJ FUNTS(n fe , 2 n> °) which shows, for instance, that NP-complete problems may be 
solved in polynomial time if we allow an exponential number of processors working in parallel, as expected. 

6 Some Simple Extra-Functional Behaviors 

Functional behaviors are only one possible way (albeit perhaps the most natural) of representing functions 
as behaviors. We analyze here two alternative representations, argue that the complexity of functions should 
not be altered by switching to these representations, and show that this is indeed the case in our framework, 
therefore providing a further sanity check. 

Definition 18 (Functional server) Let f : W — > W be a function. The functional server behavior in- 

dcf 

duced by f, denoted by Sf, is the equivalence class of the LTS given by the recursive definition X = 
i(x).(o(f(x)) | X). We denote by SSTZV the set of all functional server behaviors. 

A result similar to Lemma\l\holds, which allows us to speak of the language induced by a functional 
server behavior s, denoted by langs, and to define, given functions on natural numbers /, g, the class 
SERVTS (f,g) = lang(BTS(/, g) n SEKV). 

It is intuitively obvious that a function may be implemented "repeatedly" with given time and space 
bounds iff it may implemented once, with the same bounds. 

Theorem 4 Let f, g : N N. 

1. SERVTS(/, 5 ) C FUNTS(/, ff ); 
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2. assuming f = tt(n) and monotonic, PUNTS(/,ff) C SERVTS(0(/(n)),ff). 



Proof. Let h : W — > W. Point 1 is proved by taking a process implementing Sh and extracting from it a 
process whose execution stops after the answer to the first input. For point 2, we take an implementation P 
of the functional behavior fh and transform it into a server process which reads an external input, spawns 
a copy of P to compute h and waits for a further input. For producing the n-th output, space is reused (so 
the space cost is unchanged), while the spawning and successive inputs induce a linear slowdown, which 
is absorbed in the big-0 notation. See|C]for more details. □ □ 

In what follows, we endow the set W with the prefix order, denoted by <. A computable monotonic 
function h may obviously be implemented in the usual, "offline" way: a string £ is given, and h(£) is 
output. However, h may also be computed "online": bits are given one at a time and, for each new bit, only 
the "difference" with respect to the output already produced is given. Intuitively, the intrinsic difficulty of 
computing h should not depend on which of the two implementations is chosen. 

Definition 19 (Online monotonic function) Let h be a monotonic function. The online behavior induced 
by h, denoted by Oh, is the equivalence class of the LTS X{e,e), with X given by the following recursive 
definition: 

X(s, r) d = o(h(s) \ r) \ i(x).if [x = e] then X{sO, h(s)) else X(sl, h(s)), 

where £\v is defined when v < £ and is equal to the string v' such that £ = vv' . Note that we take the 
empty string to represent the bit 0, and any other string to represent 1. 

Theorem 5 Let f,g:N—>Nbe both O(n) and monotonic, and let h be a monotonic function on W. 
Then: 

1. o h G BTS(/, 5 ) implies f h G BTS(0(n ■ /(2n)), 0(<?(2n))); 

2. f h G BTS(/, 5 ) implies o h G BTS(C(n • /(n/2)), 0(g(n/2))). 

Proof. Consider an implementation Q of Oh- To implement fh, we read the input string and send it bit by 
bit to Q, concatenating the outputs. For a string of size n, Q is called n times; the j-th time cost is f(2j) 
(the size of each bit is at most 2 — remember that even the empty string has size 1), so the total time cost 
of the final (and only) output event is bounded by X^=i /(^i)- Since / is monotonic, we may bound this 
by n ■ f(2n). There is also the cost of sending n bits to Q, which is 2n and is thus absorbed in the big-O 
notation. For space, apart from the memory used by Q, we need only store the input string and use one bit 
at a time in the communication channels, so we still get 0(g(n)). 

Let now P be an implementation of fh- We may implement 0/, as follows: we start by sending e to P in 
order to output h(e); then, each time we get a new bit, we call P on the string received so far and we output 
only the difference with respect to the output cumulated so far. For the n-th output event o n , P is called 
n times (ignoring the call on the empty string, which has a constant cost); the j-th time, we send a string 
of length j (which costs us j) and we receive something after f(j) steps (the time it takes for P to do its 
computation). The time we need to compute the difference w.r.t. the previous output may be absorbed into 
/(j), because it is linear. Therefore, we may write time(o„) < + fti)) — ®( n ' f( n ) + n2 ) — 

0(n- f(n)), because f(n) = Cl(n). Since ||o„|| = 2n (remember that each bit is of size 2), we have the 1/2 
factor which appears in the statement of the theorem. For space, apart from the space g(n/2) used by P, 
which is reused each time, we need to keep track of the output string (so we can compute the difference), 
whose size is also bounded by g(n/2). □ □ 

A monotonic function h : W — > W is said to be eventually strictly monotonic (ESM) if, for all n G N, 
there exist £, v G W such that |£| > n, £ < v and h(£) < h(v). ESM functions may be seen as functions 
from streams of bits to streams of bits. The online process we introduced above is then an intuitive way of 
defining a function on streams. 

Another point of view [?] sees stream functions as having type (N — > {0, 1}) — > N — > {0, 1}, which 
can be Curryed into N x (N — s> {0, 1}) — > {0, 1}. That is, given a desired position i on the output stream 
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and an oracle for the input stream, we should be able to say what is the bit at position i. For computable 
functions, the oracle is consulted only finitely many times, and therefore the function is continuous. Thus, 
a computable stream function corresponds to an ESM function on finite strings: a string of length n is 
mapped to the longest prefix of the stream that does not ask the oracle for the value of the input stream at 
positions greater than n. To capture this representation of streams in our framework, the notion of behavior 
must be modified to take into account the use of oracles. We plan to do this in future work. 

7 Discussion 

The idea to revise and extend the theory of computability (and formal languages) by replacing functions 
with behaviors is not new [?, ?, ?, ?]. As an example, the latter works introduce reactive Turing ma- 
chines (RTMs), which are ordinary Turing machines with an additional action (i.e., an element of A as in 
Definition[T]i for each transition between configurations. Each such RTM induces an LTS, which then is ex- 
ecutable by definition; two RTMs execute the same behavior if their LTSs are related by a certain behavioral 
equivalence. Finally, so-called effective LTSs, i.e. LTSs with recursively enumerable transition relations, 
coincide with executable ones (up to behavioral equivalence). As one might expect, it is easy to construct 
for each RTM (without final states) a corresponding process such that their LTSs are weakly bisimilar (see 
AppendixlDl). 

Not much has been said about interactive complexity, however. A notable exception is Japaridze's sys- 
tem of Clarithmetic [?], whose focus however is on logic rather than complexity theory. Another example 
are lineage of automata [?], whose nature is very finitistic contrarily to the one of our model. 

Concerning our own work, in this extended abstract we described merely the first steps of a proposal 
which, at least in the case of polynomial and superpolynomial deterministic time complexity classes, has 
the good taste of not being inconsistent with the standard definitions. Starting from here, we have of course 
a great number of open questions and directions for further investigation. 

First of all, in light of Theorem^ we may ask how standard space complexity classes (e.g. PSPACE) 
may be recovered from our definitions. In this respect, we already know that, in perfect analogy with 
one-tape Turing machines, the sequential treatment of input strings in the current definition of the process 
machine prevents us from capturing "low" complexity classes, such as L (or NC). To deal with these, 
random access to the bits of an input string must be allowed (see Appendix lA.4l and lA.51 >. 

And then, of course, there is a plethora of questions regarding non-functional behaviors, the main 
motivation behind our work. What happens when we consider more than one external input/output? What 
interesting classes of non-functional behaviors can we describe? One issue revealed by our preliminary 
investigations is that the equivalence chosen in the definition of behavior may need to be changed. For 
instance, for dealing with streams (cf. end of Sect. [6]), something like refinement (i.e., bisimilarity in which 
some internal choices may be disregarded) seems to be more adapted. 
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A Encoding standard computational models 



A.l Turing machines 

We show how the process machine can simulate a deterministic Turing machine with a constant slowdown. 

Let 5 be a function from W to processes with free variables among x , whose domain is finite. Such 
function may be represented by a process (identifier) F$(s, x) which progressively "explores" s and re- 
turns the appropriate process, returning some default process (for instance 0) in case s does not belong to 
the domain of S. For example, if 5 is defined only on e, and 1, and is a closed process in all cases, we 
have 

F s (a) d = £?(s). (5(e), 7 (s).(e 7 (tatf(a)). (6(0), 0),s ? (tail(s)). {6(1), 0))). 

Let now M be a deterministic Turing machine with alphabet {0, 1} and one semi-infinite tape (i.e., it is 
finite to the "left" and extends indefinitely to the "right"). We assume that the input string is written in the 
leftmost cells of the tape, the rest of the tape being covered by blank symbols. We also assume that the 
machine halts with a failure if it attempts to read to the left of the leftmost cell. 

The configurations of the machine may be represented by three binary strings s, I, r, representing the 
current state, the contents to the left of the head, in reverse order and the contents of the tape to the right 
of the head (including the head as the first symbol of r). Then, the transition function of M induces three 
functions of s, depending on whether r is empty (the head "wandered off" to the right), starts with a 0, or 
starts with a 1. These, in turn, induce three functions 6 e , <5 , Si, from binary strings to processes, all of 
finite domain, which we describe as follows: let T be a process identifier of arity 3. Suppose the state of 
M is s, and that the current symbol is b (which may be blank). Suppose that, from this information, the 
transition function of M goes to state q, writes c, and moves to the right. Then, we have 

6 b (s)=T{q,c(l),tail(r)). 

Had the transition function of M decreed a movement to the left instead, we would have 

6 b (s) = e?(Z).(0, ? (/).(T(g, tail(l), 0(c(tail(r)))),T(q, tail (I), l(c(tail(r)j))j). 

Finally, if s is a halting state, the machine may output the result, which we stipulate to be written to the 
right of the head (including the current position), so we have 6b(s) = o(r). 

But we still have to define the behavior of the process identifier T: the defining equation for it is 

T(s, v, I) d ^ f ei(r).(F Se (s, I, r),0 ? (r).(F So (s, I, r),F Sl (s, I, r»). 
The Turing machine M may be represented by the process 

i(x).T{£ ,e,x), 

where £o is the initial state of M. 

Note how the parallel operator is never used by processes representing Turing machines. This implies 
that, when such processes are executed on the process machine, only one processor is used, and the causal 
structure of events is purely sequential. Note also that we may encode in the same way any computational 
model based on states whose transitions are described by a function of finite domain. 

A.2 Alternating Turing machines 

It is immediate to define processes corresponding to binary logical operators: 

And(a,b,c) = a(x).b(y).0Ax).(c(0),O ? (y).(c(0),c(l))); 
Or(a,b,c) = a(x).b(y).0 ? (x).(0 ? (y).(c(0),c(l)),c(l)). 

Consider now an alternating Turing machine M. We suppose that at every step, M non-deterministically 
branches in two computations; some states will be existential (i.e., will accept if the result of one of the 
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two branches is accepting), while others will be universal (i.e., will accept if the result of both of the two 
branches is accepting). Then, the transition function of M induces 6 functions of finite domain from strings 
to processes, which we call 6 z b (s), with b G {0, 1, e} and i G {0, 1}. Intuitively, Sl(s) corresponds to the 
behavior of M when, given that the current state and symbol are s and b, the branch % is chosen. 

The functions S l b (s) are defined much like in the case of deterministic Turing machines, except that now 
we use another process identifier N, of arity 4. For instance, if state s, symbol b, and branch i give new 
state q, new symbol c, and movement to the right, we have 

5i(s)=N(q,c(l),tail(r),d), 

and so on. An important difference with deterministic Turing machines is that, in case s is an accepting 
state, we set S l b (s) = d(l), and in case it is a rejecting state, we set S l b (s) = d(Q), that is, the final decision 
(accept/reject) is output on an internal channel d, which is a parameter of N, instead of the external output 
channel o. 

Then, we introduce two further process identifiers 7b, Ti, both of arity 4, and define them mutually 
recursively with N: 

Ti(s, I, r, d) = e?(r).(F s < (s, I, r, d), ? (r).(i^ (s, I, r, d), F S{ (s, I, r, d»); 
N(s,r,l,d) = T (s,l,r, 0(d)) | 7i(s, l,r, 1(d)) \ (0(d))(y).(l(d))(z).F Op ( Sl y,z,d). 

where i £ {0, 1} and Op(s) is the finite-domain function yielding Or(y, z, d) or And(y, z, d) according 
to whether s is an existential or universal state, respectively. 

At this point, the alternating Turing machine M may be represented by the process 

i(x).(N(£o,x,e,e) | ^(y).o(y)), 

where £ is me initial state. 

The reader may check that, upon reception of a string x on the external input channel i, the above 
process starts unfolding a parallel computation whose structure is a binary tree of depth proportional to 
the depth of the computation of M, Each branch in the tree executes independently from the others; 
once a leaf is reached, the result (acceptance/rejection) is communicated to the parent, which computes 
a disjunction/conjunction of the two data received from its siblings, depending on its existential/universal 
nature, and passes the result to its parent, and so on. The last Boolean computed, which is the final answer 
of M for accepting or rejecting x, is sent on channel £, and is forwarded to the external world through the 
output channel o. 

A.3 Random Access Machines 

A memory cell may be represented by a process which waits on a channel £ for a string v which is inter- 
preted as follows: 

- if v = e, no action is taken; 

- the string v = Qv' is interpreted as a read request, and the value stored in the cell is sent using channel 

v'\ 

- the string v = lv' is interpreted as a write request, so the value v' replaces the current value. 
The above process is realized by the following recursive definition: 

C(x,v) d = x(y).e?(y).(C{x,v),0?(y).(tail(y){v).C(x,v),C(x, tail(y)))). 

In RAMs, memory cells contain integers, and instructions too refer to integers. Here, we use a unary 
representation: n is represented by the string 0" . 

A random access memory made of infinitely many cells initially containing zero, located at addresses 
of the form 0™, with n > 0, is generated by the process M(0), where the unary process identifier M has 

the following defining equation M(c) d = C(c, e) | M(0(c)). However, such a process is divergent, so 
we cannot use it for implementing functional behaviors according to Definition [5] Then, we must define 
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a process that only creates a finite number of memory cells at a time, as needed. We first give a couple of 
auxiliary definitions: 

D[P, Q](m, n) d = £?(m).(P, e ? (n).(Q, D[P, Q](to«(m), tail(n)))) 

E[P, Q](m, n) d = £?(m).(e?(n).(P, Q),e?(n).(Q, E[P, Q]( tail (m) , iaiZ (n) } ) ) 

These definitions are parametric in two arbitrary processes P, Q. Given two integers m, n represented as 
lists of zeros, the process D[P, Q] (m, n) (resp. E[P, Q] (m, n}) evaluates to P if m < n (resp. m = n) and 
to Q otherwise. Then, the memory process M may be defined as follows: 

M'(m,ri) d = C{m,e) \ E[0,M'{0(m),n)]{m,n) 

M(c) d = l(x).D[M{c),M'(0(c),x) \ M(x)](x,c). 

In other words, M{c) waits on channel 1 for an integer x, which corresponds to the address of a memory 
cell. If x < c, the process returns to its initial state M(c). If x > c, the process goes to state M(x) and, in 
parallel, creates x — c memory cells, each initialized to zero, at the addresses going from c + 1 to x. 

A RAM program is a finite sequence of instructions, which may be represented by mutually recursively 
defined process identifiers I-y, . . . , I n , Ij standing for the jth instruction. These processes access the mem- 
ory M with the instructions allowed by the RAM (load/store operations, possibly with indirection), and 
do simple arithmetic operations (increment/decrement) on the contents of a special memory cell located at 
the channel e, and called the accumulator. Of course, before accessing the memory cell at address c, each 
instruction must take care of sending c on channel 1, which has the effect of creating the cell if it does not 
exist (and has no effect otherwise). The HALT instruction corresponds to the process 

e(0O | S(v).V(v), 

which reads the value stored in the accumulator and forwards it to the external world through the output 
channel o (the string £ is arbitrary, as long as it is of length at least 2 and starts with 1 to avoid unwanted 
interferences). 

Then, such a RAM program may be represented by the process 

i(x).(h | C{e,x)) | M(0). 

Note that this encoding is not quite economic in terms of parallelism: a RAM is a sequential machine, 
whereas executing its encoding given above on the process machine will use several processors. However, 
it has the advantage of being easily generalized to PRAMs (see Sect. lA.5l >. 

A.4 Boolean Circuits 

The definitions of And and Or given above may be easily adapted to encode gates, from which a Boolean 
circuit is implemented immediately. For what concerns the interface, a circuit with m inputs and n outputs 
will be represented by a process reading bits from the external input channels i\, . . , ,i m and sending bits 
to the external output channels o±,...,o n . 

Note that the behavior of a process representing a Boolean circuit as above is not functional (Defini- 
tion|5J- Therefore, although this encoding shows how circuits may be simulated on the process machine, it 
does not help extending Theorem|2]to sublinear classes such as NC. 

A.5 Parallel Random Access Machines 

A PRAM is composed of several RAM programs running in parallel, each with its own accumulator. 
They access the same memory, including the accumulators of all other programs. At each step, the current 
instruction of every program is executed, and the machine proceeds to the next step only when the execution 
of all instructions is complete; in other words, the parallel components share a clock. Concurrent access to 
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memory is resolved on a first-come-first-served basis; it is the programmer's responsibility to ensure that 
the cooperation between the PRAM programs is consistent. 

A PRAM program with n parallel components is implemented by a process of the following form: 

h(xi).{j{ | C(0,xi» I ••• I i n (x n ).(J? I C(O n ,x n )) | M(0 n+1 ) | K n . 

The idea is that we put the encodings of the n RAM programs in parallel, plus a clock process K n . The ith 
program has an associated internal channel, say 1\ with which it communicates with the clock. 

If Ij is the process encoding the jth instruction of a RAM program, the same instruction in the ith 
component of the PRAM is encoded by a process J 1 - of the form 

where the input prefix V bounds a variable which does not appear in and where I' is / in which a bogus 
string is sent on channel V upon completion of the instruction. The encoding of the HALT instruction is 
defined so that the ith program sends the contents of its accumulator through the external output channel 

o L . 

The clock may then be represented by the process defined as follows: 

K n = T i«i r.K n , 

where an output action of the form P means that the data sent is irrelevant. 

In contrast with the representation of Boolean circuits (Sect. lA4l i. the above encoding of PRAMs does 
yield functional behaviors. However, since the initial input instruction has a linear cost in the length of 
the input string, no process representing a PRAM runs in sublinear time. With the present definition of 
functional behavior, sublinear time classes (such as NC) may be captured only if we modify the process 
machine, for example allowing random access to the bits of the input string. 

B Proof of Theorem 111 

Points (1) and (3) are consequences of the encoding of lA.ll and lA.2l 

For what concerns point (2), suppose there is a process P deciding a language in time f(n) and space 
g(n) on the process machine. First of all, observe that, since [P] is functional, the non-determinism that 
may be present in P is vacuous. Indeed, all choices made during the execution of P with a given input 
yield the same output; moreover, since «d does not introduce divergence, the execution of P terminates no 
matter what choice is made. Therefore, a deterministic Turing machine may simulate the process machine 
executing P by simulating the transitions in any order (for instance, since the coding of a configuration 
[r]0 will actually represent the set T as a list, we may choose to always execute the transition given by the 
first processor of the list). 

We proceed to define the Turing machine simulating the execution of P. We start by fixing an encoding 
(•)* of configurations of the process machine as strings of a suitable (finite) alphabet. This may safely be 
supposed to satisfy, for every configuration C, \C*\ = k\C\, where k is a positive constant. Moreover, 
we suppose that C* has a distinguished processor among the ones active in C. The Turing machine is 
initialized with a binary string £ on its input tape, and the string ([(P, 0) e ]e)* on its work tape, with the 
distinguished processor being the only active one. 

Now, at each step, the Turing machine looks at the state (Q, M) p of the distinguished processor. De- 
pending on the shape of Q, the Turing machine simulates the appropriate transition. If Q = i{x).R (by 
bisimulation, the channel must be i), the Turing machine assigns to x the string placed on its input tape. 
If Q = o(E).R (by bisimulation, the channel must be o) the Turing machine halts; it accepts iff E M = e 
(remember the convention used in Definition|6]l. In all other cases, the Turing machine simulates the neces- 
sary operations and updates the encoding of the configuration accordingly. There are only two cases worth 
of attention. The first one is that in which Q = E(x).R and the queue E M is empty. Then, the Turing 
machine simply selects a new distinguished processor (taking care of finding one which is not blocked), 
and simulate the next step from it. The second one is that in which Q = R \ S. In that case, after the 
spawning is simulated, the distinguished processor is chosen to be the one executing R. 
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Thanks to the properties of sa^ (in particular the fact that it does not introduce divergence), the above 
Turing machine is guaranteed to terminate with the correct state of acceptance/rejection w.r.t. the input 
string, which we suppose to be of length n. Note that, globally, the Turing machine actually simulates a 
run Cq — > C\ — > ■ ■ ■ — > Ct- Consider now the tree defined as follows: the nodes at level < % < t 
represent the active processors in Cf, the root represents the only active processor in Co and, at each 
level, the siblings of a node are either one node (the processor did not spawn) or two nodes (the processor 
spawned), or none at all (the processor went idle). Now, obviously each transition in the run requires an 
active processor; therefore, t is bounded by the size of the above tree. But such a tree has height bounded 
by f(n) and width bounded by g(n), so t < f(n)g(n). The simulation of a single transition Cj — ^ Ci+\ 
of the run may be assumed to require at most something like c • max(|Ci|, \Ci+i\) h Turing machine steps, 
where c, h are positive constants, which is bounded by ck-g(n) h . Hence, the runtime of the Turing machine 
is bounded by cfc • f(n)g(n) h+1 . 

C Proof of Theorem a 

Let h : W — » W. Point 1 is obvious: from a process Q implementing Sh in time / and space g, we 
syntactically extract a process implementing f/j by simply tracing the execution of Q after the first input 
is given, halting immediately after the output is computed. The time and space bounds are obviously the 
same. 

For point 2, we take an implementation P of the functional behavior fh and transform it into a server 
process which reads an external input, spawns a copy of P to compute h and waits for a further input. If o„ 
is the event corresponding to the output of after the strings £i, ■ • • ,£ n nave been read, we have that 
any chain of events whose maximum is o n has the form i\ < e[ < ■ ■ ■ < i n < e r n < d\ < ■ ■ ■ < d r m < o n , 
where the ij are the input events reading £j, the ej are spawn instructions, and d[, . . . , d T m are events 
occurring in the computation of h(£ n ), so their total time cost is at most /(|£ n |). Therefore, assuming / 
to be monotonic and at least linear, we have time(o„) = C(/(|£„|) + 5^" =1 (1 + = + 
||o„||) = 0(f(\\o n |D). On the other hand, the space cost is identical. 

D Reactive Turing machines 

We base our discussion of reactive Turing machines [?] on the following two definitions from [?] because 
the latter work mentions explicitly the alphabets (while the former work leaves this information implicit). 

Definition 20 (Reactive Turing machine) A Reactive Turing machine is a six-tuple M = (S, A, V, — >, | 

, J.) where: 

1. S is a finite set of states, 

2. A is a finite action alphabet, A T also includes the silent step t, 

3. T> is a finite data alphabet, we add a special symbol □ standing for a blank and put T>\j = T> U {□}, 

4. ->C5x A T x T>\j x D\j x {L, R} x S is a finite set of transitions or steps, 

5. j" G S is the initial state, 

6. 4- £ S is the set affinal states. 

Intuitively, the machine starts at the initial state j" with an empty tape; as usual a configuration consists 
of the state and the tape contents (an element of T>^) and a position of the read-write head with a single 
symbol. The possible transitions of a configuration depend on the state and the symbol under the head. 
Each transition comes with a (possibly observable) action and a change on the tape as usual. 

Definition 21 (LTS of an RTM) Let M = (S, A,T>,^, f, |) be an RTM. The labeled transition system of 
M, denoted by T(M), is defined as follows. 
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1. The set of states is the set of configurations {(s, 5) \ s G S, 6 a tape instance}. 

2. The transition relation is the least relation that satisfies the following two properties for all a G 
A T , d, e G Dq, and S, £ G 

. { s ,8dO^{t,{S)eC)iffs^^% 
. ( s ,SdO^(t,Se(X))iffs^^t. 

3. The initial state is (t, □). 

4. (s,S)iiffsi. 

We have not introduced all notation as we have the usual use of a "marker" on tape symbols, i.e., the 
marked symbol d for each d G V. 

For the encoding of RTMs into processes, we assume that the action alphabet A has a suitable coding 
into words, i.e., that each a G A has a binary code a G W \ {e} such that a is a palindrom^. Now, we 
shall code each action a G A by the prefix o{a). First, we ignore termination, which is a minor point as 
discussed in RemarkQ] Similarly, states and data symbols are assumed to have binary codes. 

The encoding will use of the following auxiliary definition of internal choice. 

Definition 22 (Choice at a channel) Let £ G W be a word, let n > be a natural number, and let 
Pi, . . . , P n be a finite family of processes. Now, we define the process 2^2i<i< n inductively as follows. 

l<i<0 

E ^ 

l<i<m+l 

If f is omitted, it is automatically e, i.e., Y^KiKmP stan ds for 2~2i<i< m -^i- ^ e W1 "i te -Pt + ? Pi f° r 

Ei <,<2 Pi and Pi + p 2 for Ex<i< 2 Pi- 

The encoding of an RTM will be a recursive process with six string parameters: besides the state s, the 

symbol on the tape under the head d, and the left and right tape contents <fi and ip, we will use two auxiliary 

strings a, p G W, which "divide" <fi and ip into cells of suitable length. We shall also have an auxiliary 

processes for the manipulation of pairs of these strings, each of which is used to represent a stack: the first 

string of a pair contains the actual stack content and the other string is the O-separated list of the unary 

encodings of the lengths of the elements in the stack. For example the pair (01100000, 1111011110) is a 

stack with element 0110 on top of element 0000. The complete encoding of RTMs is now as follows. 

Definition 23 (Encoding RTMs without termination) Given a reactive Turing machine M = 
(5, A, T>, — >, j, J,) with J. = 0, its encoding is the process T(s, £,£,□, e, e), with the following definitions. 

T(s, (/), a, d, ip, p) = 

E o(a).(Pop^,p,s) I 0{d').0^').0{p').T(t,e ( l>,1^0a 1 d'^ l ,p l )) + 



E o{a).(Pop(^a,e) | 0(d').0(4>').0(a').T(t,4,',a',d',eij,1^0p)) 

a.[d/e]L 

s — : >t 

Pop(Z,0,v) = [ e? (0)]. (0(Q). 0(e). 0(e). 0, [0,(0)]. (O^).O<£>.O<tajZ(0)).O, P)) 
where P is 

P = [O 7 (0)]. (Pop(tail(£), tail(6),0v), Pop(tail(£), tail(6), lv)) . 

2 This makes the encoding simpler and causes only a constant factor in size and time. 
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The Pop-process takes a pair of words - representing a stack - and an "accumulator" for the bit-wise 
compilation of the top element; it "returns" the top symbol and the updated "stack" via consecutive outputs 
on channel 0. 

Proposition 6 (Simulation of RTMs) Every RTM with the empty set of final states can be simulated by a 
process. 

Proof, [idea] All non-determinism of the RTM is captured at the root of the definition of the process iden- 
tifier T of Definition [23] Now, it remains only to verify that the rest of the process actually encodes the 
reactive Turing machine as expected. Note that there will never be any "garbage" sending actions on the 
"channels" and e. □ 

Remark 1 (Termination) As for termination, without changing much, we could add a new process con- 
stant 1 to our process syntax; it would essentially behave as with the sole difference that if all processes 
in a configuration have reduced to 1 (in an arbitrary environment and with arbitrary queues), then the 
configuration is a final configuration. 

Effective transition systems An LTS is effective, according to [?, Definition 5], if the transition relation 
is recursively enumerable. Note that we again ignore termination for the sake of simplicity (cf. Remark[TJ. 
Clearly, the LTSs of processes are recursively enumerable. 
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